Supplementary Material: Deep 360 Pilot: Learning a Deep Agent for Piloting through 360◦ Sports Videos

نویسندگان

  • Hou-Ning Hu
  • Yen-Chen Lin
  • Ming-Yu Liu
  • Hsien-Tzu Cheng
  • Yung-Ju Chang
  • Min Sun
چکیده

r(lt(i), l gt t ) = { 1− ‖lt(i)−l gt t ‖2 η , if ‖lt(i)− l gt t ‖2 <= η −1, otherwise (1) where η equals the distance from the center of a viewing angle to the corner of its corresponding NFoV, i.e., √ 32.752 + 24.562 = 40.9 if we define NFOV as spanning a horizontal angle of 65.5◦ with a 4 : 3 aspect ratio. When lt == l gt t , the reward is 1, which is the maximum reward. When ‖lt(i) − l t ‖2 > η, i.e., the predicted viewing angle is not covered by ground truth viewing angle’s NFoV, the reward is -1.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep 360 Pilot: Learning a Deep Agent for Piloting through 360° Sports Videos

Watching a 360 sports video requires a viewer to continuously select a viewing angle, either through a sequence of mouse clicks or head movements. To relieve the viewer from this “360 piloting” task, we propose “deep 360 pilot” – a deep learning-based agent for piloting through 360 sports videos automatically. At each frame, the agent observes a panoramic image and has the knowledge of previous...

متن کامل

A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video

We address the problem of highlight detection from a 360◦ video by summarizing it both spatially and temporally. Given a long 360◦ video, we spatially select pleasantlylooking normal field-of-view (NFOV) segments from unlimited field of views (FOV) of the 360◦ video, and temporally summarize it into a concise and informative highlight as a selected subset of subshots. We propose a novel deep ra...

متن کامل

360° View Camera Based Visual Assistive Technology for Contextual Scene Information

360° View Camera Based Visual Assistive Technology for Contextual Scene Information Mazin Ali Supervising Professor: Dr. Ferat Sahin In this research project, a system is proposed to aid the visually impaired by providing partial contextual information of the surroundings using 360° view camera combined with deep learning is proposed. The system uses a 360° view camera with a mobile device to c...

متن کامل

HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video

Our perception of our surrounding environment is limited by the constraints of human biology. The field of augmented perception asks how our sensory capabilities can be usefully extended through computational means. We argue that spatial awareness can be enhanced by exploiting recent advances in computer vision which make high-accuracy, real-time object detection feasible in everyday settings. ...

متن کامل

360-Degree Video Head Movement Dataset

While Virtual Reality applications are increasingly attracting the attention of developers and business analysts, the behaviour of users watching 360-degree (i.e. omnidirectional) videos has not been thoroughly studied yet. This paper introduces a dataset of head movements of users watching 360-degree videos on a Head-Mounted Display (HMD). The dataset includes data collected from 59 users watc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017